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MURI  Project  Background 


•  Goal:  develop  dynamic  trust  management  systems  for 
Internet  principals  and  services 

-  E.g.,  IP  addresses,  DNS  domains/servers, 

BGP/AS,  etc. 

-  Avoid  connections  to/from  malicious/fraudulent 
elements  on  the  Internet 

•  Progress  thus  far 

-  Help  build  an  infrastructure,  SIE,  for  collecting  real¬ 
time  Internet  security  information 

•  Operational;  data  sources  for  dynamic  trust  management 

-  Dynamic  IP  reputation  using  DNS  data 
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•  Dynamic  Domain  Name  reputation  rating  using  passive 
DNS  (pDNS) 

-  Professional  DNS  hosting  differs  from  non-professional 

-  pDNS  information  is  already  present  in  our  network 

-  Static  IP/DNS  blacklists  have  limitations 

-  Malicious  users  tend  to  reuse  their  infrastructure 

•  Contributions: 

-  Zone  and  network  based  clustering  of  pDNS 

-  A  new  method  of  assigning  reputation  on  new  RRSETs 
using  limited  {White/G rey/Black}-listing 

-  A  dynamic  Domain  Name  reputation  rating  system 

•  Always  maintain  fresh  reputation  knowledge  based  on  pDNS 
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Passive  DNS  data 


•  28  Sensors  from  ISPs,  Banks  and  corporate 
networks 

•  Off-line  analysis  is  possible  due  to  pDNS  data 
locality 

•  Computing  Clustering  and  Classification  Vectors 

-  1 5  features  for  the  domain  name  based  vector 

-  1 6  features  for  the  network  based  vector 

•  For  Labeling  the  dataset 

-  Damballa  botnet  intelligent,  honey-pot  data, 
spam  feeds,  zeus  tracker,  do-not-route  lists. 
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Clustering  and  Classification  Vectors 
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•  Computing  Vectors  for  Clustering  and 
Classification 

-  Network  Based  vector  [1 6]: 

•  M/M/Std(#{IPs,CIDRs,ASNs,CC,RegDate,Owner,size(CIDR)}) 

-  Domain  Based  vector  [15]: 

•  M/M/Std(#{chars,TLDs,2LDs,3LDs,  {2, 3}-grams,  Non-Com}) 

•  Computing  Vectors  for  Cluster  Labeling 

-  Damballa  Intelligent  [3]  :  Black  List 

-  Other  Analysis  [3]  :  Grey  List 
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Dynamic  Domain  Name  Reputation  System 
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Cluster  Based  Rating 


Goal:  Group  relevant,  from  the  network  behavior  and  DNS 
characteristics  point  of  view,  domain  names  in  the  same  cluster 
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Cluster  based  Rating:  Details 


•  1st  Level  Clustering  (Network  Vectors): 

-  Identify  similarities  in  zones  based  solely  in 
their  network  characteristics 

•  2nd  Level  Clustering  (Network  and  Domain 
Vectors): 

-  Further  group  vectors  in  each  cluster  to  have 
domain  name  and  network  correlation 

-  Why  the  network  vectors  are  not  good  enough? 
Is  it  necessary  to  use  a  larger  vector? 

•  Yes,  that  is  the  ideal  way  to  cluster  RRsets  with 
similar  network  and  domain  name  characteristics. 
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2nd  Level  Clustering  with  Network  Vect. 
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There  is  some  separation  between  the  ideal  clusters  but 
the  combination  of  most  features  are  still  too  confused 
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2nd  Level  Clustering  with  Both  Vect. 
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Feature  0  Feature  0  Feature  0 


Using  both  vectors  we  can  see  that  the  cluster  separation 
is  more  natural  even  between  2  features.  The  combination 
of  all  features  gives  us  a  better  over  sub-cluster  separation 
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•  It  is  very  expensive  and  too  noise  to  use  both 
vectors  in  the  1st  level  clustering 

•  Using  only  the  network  vector  in  the  1 st  lever 
cluster  you  get  the  initial  domain  name  separation 

•  Finer  Grain  Analysis:  Using  both  vectors  in  the  2nd 
level  clustering  you  gives  us  better  sub-clusters 
with  less  distortion  between  “similar”  RRsets 
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Classification  Based  Rating 


Goal:  Utilize  existing  knowledge  for  special  classes  of  domain 
names  in  order  to  increase  confidence  in  the  identification  of 

RRsest  from  these  classes. 

In  other  words,  professional  DNS  hosting  (i.e  legitimate,  popular  zones)  should 
exhibit  different  network  behavior  than  promiscuous  DNS  hosting. 


5-Class  Meta 
Classifier 
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Network 
Based  Vectors 


Unlabeled 
Passive  DNS 
RRSETs 
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Labeled  RRSETs 
In  Passive  DNS 
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•  2-classes:  Very  popular  domains 

-  pop:  google,  yahoo,  amazon,  ebay,  facebook,  msn 

-  The  rest  top  100  Alexa  zones  labeled  as  “common” 

•  2-classes:  CDNs 

-  Akamai 

-  Limelight,  coralcdn,  cloudfront.com,  footprint.net 

•  1 -class:  Dynamic  DNS: 

-  DynDNS,  no-ip 


•  NOTE:  We  don’t  try  to  identify  ail  benign  traffic;  rather 
we  measure  the  network  properties  for  a  given  zone 
and  build  a  reputation  for  it 
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Dynamic  DNS  Reputation  metric 


•  The  Meta  Classification  step  will  feed  values  ( Label  [i] 
,  Confidence  [i])  for  each  vector 

•  The  clustering  step  will  provide  the  average  Euclidean 
distances  from  the  k  closest  labeled  vectors  (Gray  & 
Black) 

•  Final  reputation  score:  Still  work-in-progress 

-  A  neural  network  will  “learn”  in  (i+2/2)+1  steps  the 
reputation  rating  function  from  returned  values  of 
the  supervised  and  unsupervised  process  and  the 
labeled  data 

-  Overall  results  ...  soon. 

-  Per  process  results  follows 
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Evaluating  the  Meta  Classifier 


•  The  Confusion  Matrix 

-  Remind:  Our  goal  is  not  assign  labels  to  vectors  based  on  information 
that  we  can  easily  collect 

-  The  label  we  used: 

•  dynamic  (noip,dyndns),  akamai  (akamai,  akadns),  pop  (google,  amazon, 
ebay,  yahoo,  msn),  common[  !(pop)  &  in  top  100  alexa.com  domains) 
and  CDN  (limelight,  footprint,  cloudfront,  coralcdn) 
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Evaluating  the  Clustering  process 


1st  Level  Clustering: 

-  Goal:  get  a  preliminary  separation  between 
vectors  based  on  network  properties 


-  We  get  many  clusters: 


Grey  and  Black  areas  per  cluster:  1st  Level  Clustering 


100000 


•  Benign  (0,3) 

•  Malicious  (6,17,15) 

•  and  mixed  (i.e.14,7) 

2nd  Level  Clustering: 
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-  Need  for  finer  grain 
analysis.  How  cluster  14 
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would  looks  like  after  this  step? 
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mycmdscale[,2] 


2nd  Level  Clustering:  Cluster  14 
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Intuition:  The  2nd  level  clustering 
process  is  capable  in  many  cases  to 
differentiate  the  known  benign  and 
professionally  operated  zones  from 
the  rest,  by  using  the  combined 
network  and  domain  name  vector 
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Green:  IRC  Domain 
Black:  CDNs 

Blue  &RED:  mixed  C&C  domains 


mycmdscale[,1] 
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Conclusion  and  Future  Work 


•  What  we’ve  learned 

-  pDNS  contain  an  interesting  information  signal 

-  We  identify  the  features  that  can  harvest  this 
signal  from  the  pDNS  DB 

-  Classification  works  great  &  Clustering  needs 
more  tuning 

•  What’s  the  next  step 

-  Benchmark  the  reputation  function 

-  Utilize  information  from  the  zone  authority  (ANS) 
to  assist  in  better  RRset  inter-cluster  association 
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Beyond  the  Immediate  Next  Step 


•  Incentivize  “good  behaviors”  from  networks 

-  E.g.,  do  not  host  bad  domains  just  for  the 
money 

-  If  trust  dynamic  trust  score  of  IP  or  Domain 
depends  heavily  on  the  trust  score  of  the 
network  service  provider,  the  provider  could 
lose  legitimate  domains  if  it  hosts  a  few  number 
of  bad  domains 

•  Ultimate  goal: 

-An  on-line  dynamic  trust/reputation  service  for 
IP/Domain 
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